Student Growth Percentile Fit Plots
A goodness of fit plot is produced for each unique analysis run in 2018. All fit plots will contain at least four panels. Each panel is a different depiction of the distribution of the Student Growth Percentiles (SGPs) calculated in that analysis relative to the students’ prior or current achievement (i.e. the test scores used as the independent and dependent variables in the model).
The top panel is a mosaic plot that shows the percentage of students that fall into each prior proficiency level, and the location of the 10th through 90th quantiles of the SGP distribution represented as dashed white lines (with the exception of the solid white line for the median/50th percentile). Ideally the median SGP will be at or near 50 for all prior achievement level groups. The top panel is excluded when students’ prior achievement level data is unavailable.
The “Ceiling/Floor Effects Test” panel helps identify problems in SGP estimation at the Highest and Lowest Obtainable/Observed Scale Scores (HOSS and LOSS). Appendix C provides a more detailed description of ceiling and floor effects and their causes. The table of values shows whether the current year scores at both extremes yield expected SGP values. The expectation is that the majority of SGPs for students scoring at or near the LOSS will be low (preferably less than 5 and not higher than 20), and that SGPs for students scoring at or near the HOSS will be high (preferably higher than 95 and not less than 80). Because few students may score exactly at the HOSS/LOSS, the top/bottom 50 students are selected and any student scoring within their range of scores are selected for inclusion in these tables. Consequently, there may be a range of scores at the HOSS/LOSS rather than a single score, and there may be more than 50 students included in the HOSS/LOSS row if the 50 students at the extremes only contain the single HOSS/LOSS score.
The “Student Growth Percentile Range” panel at bottom left shows the empirical distribution of SGPs given prior scale score deciles in the form of a 10 by 10 cell grid. Percentages of student growth percentiles between the 10th, 20th, 30th, 40th, 50th, 60th, 70th, 80th, and 90th percentiles were calculated based upon the empirical decile of the cohort’s prior year scaled score distribution. Deviations from perfect fit are indicated by red and blue shading. The further above 10 the darker the red, and the further below 10 the darker the blue. A more detailed discussion about the reasons for and implications of model misfit can be found in the “Goodness of Fit” section of the 2018 Georgia Student Growth Model report.
The bottom right panel of each plot is a Q-Q plot which compares the observed distribution of SGPs with the theoretical (uniform) distribution. An ideal plot here will show black step function lines that do not deviate from the ideal, red line which traces the 45 degree angle of perfect fit.
Goodness of fit plots for SIMEX measurement error corrected models are also presented here for each analysis. The expectations in the SGP distribution panels are different for these models, where lower attaining students will recieve higher SGPs and vice versa. This typically shifts the median lines in the mosaic plot panel and causes a red shift (more SGPs than expected) in the upper right and lower left quadrants of the “Student Growth Percentile Range” panel. See Appendix B of this report for a more detailed discussion of SIMEX models and description of their impact on SGP distributions.
End-of-Grade Analyses
ELA
Fig. A.1: Goodness of Fit Plot for Spring 2018 Grade 4 ELA (Uncorrected - One Prior).
Fig. A.2: Goodness of Fit Plot for Spring 2018 Grade 4 ELA (Ranked SIMEX - One Prior).
Fig. A.3: Goodness of Fit Plot for Spring 2018 Grade 5 ELA (Uncorrected - Two Priors).
Fig. A.4: Goodness of Fit Plot for Spring 2018 Grade 5 ELA (Ranked SIMEX - Two Priors).
Fig. A.5: Goodness of Fit Plot for Spring 2018 Grade 6 ELA (Uncorrected - Two Priors).
Fig. A.6: Goodness of Fit Plot for Spring 2018 Grade 6 ELA (Ranked SIMEX - Two Priors).
Fig. A.7: Goodness of Fit Plot for Spring 2018 Grade 7 ELA (Uncorrected - Two Priors).
Fig. A.8: Goodness of Fit Plot for Spring 2018 Grade 7 ELA (Ranked SIMEX - Two Priors).
Fig. A.9: Goodness of Fit Plot for Spring 2018 Grade 8 ELA (Uncorrected - Two Priors).
Fig. A.10: Goodness of Fit Plot for Spring 2018 Grade 8 ELA (Ranked SIMEX - Two Priors).
Fig. A.11: Goodness of Fit Plot for Spring 2018 Grade 9 ELA (Uncorrected - Two Priors).
Fig. A.12: Goodness of Fit Plot for Spring 2018 Grade 9 ELA (Ranked SIMEX - Two Priors).
Fig. A.13: Goodness of Fit Plot for Spring 2018 Grade 10 ELA (Uncorrected - Two Priors).
Fig. A.14: Goodness of Fit Plot for Spring 2018 Grade 10 ELA (Ranked SIMEX - Two Priors).
Fig. A.15: Goodness of Fit Plot for Spring 2018 Grade 10 ELA (Uncorrected - One Prior).
Fig. A.16: Goodness of Fit Plot for Spring 2018 Grade 10 ELA (Ranked SIMEX - One Prior).
Fig. A.17: Goodness of Fit Plot for Spring 2018 Grade 11 ELA (Uncorrected - Two Priors).
Fig. A.18: Goodness of Fit Plot for Spring 2018 Grade 11 ELA (Ranked SIMEX - Two Priors).
Fig. A.19: Goodness of Fit Plot for Spring 2018 Grade 11 ELA (Uncorrected - One Prior).
Fig. A.20: Goodness of Fit Plot for Spring 2018 Grade 11 ELA (Ranked SIMEX - One Prior).
Mathematics
Fig. A.21: Goodness of Fit Plot for Spring 2018 Grade 4 Mathematics (Uncorrected - One Prior).
Fig. A.22: Goodness of Fit Plot for Spring 2018 Grade 4 Mathematics (Ranked SIMEX - One Prior).
Fig. A.23: Goodness of Fit Plot for Spring 2018 Grade 5 Mathematics (Uncorrected - Two Priors).
Fig. A.24: Goodness of Fit Plot for Spring 2018 Grade 5 Mathematics (Ranked SIMEX - Two Priors).
Fig. A.25: Goodness of Fit Plot for Spring 2018 Grade 6 Mathematics (Uncorrected - Two Priors).
Fig. A.26: Goodness of Fit Plot for Spring 2018 Grade 6 Mathematics (Ranked SIMEX - Two Priors).
Fig. A.27: Goodness of Fit Plot for Spring 2018 Grade 7 Mathematics (Uncorrected - Two Priors).
Fig. A.28: Goodness of Fit Plot for Spring 2018 Grade 7 Mathematics (Ranked SIMEX - Two Priors).
Fig. A.29: Goodness of Fit Plot for Spring 2018 Grade 8 Mathematics (Uncorrected - Two Priors).
Fig. A.30: Goodness of Fit Plot for Spring 2018 Grade 8 Mathematics (Ranked SIMEX - Two Priors).
End-of-Course Analyses (by Course Progression)
Algebra I
Fig. A.31: Goodness of Fit Plot for Spring 2018 Algebra I (Priors Spring 2017 Math Grade 8, Spring 2016 Math Grade 7 - Uncorrected).
Fig. A.32: Goodness of Fit Plot for Spring 2018 Algebra I (Priors Spring 2017 Math Grade 8, Spring 2016 Math Grade 7 - Ranked SIMEX).
Fig. A.33: Goodness of Fit Plot for Spring 2018 Algebra I (Priors Spring 2017 Math Grade 7, Spring 2016 Math Grade 6 - Uncorrected).
Fig. A.34: Goodness of Fit Plot for Spring 2018 Algebra I (Priors Spring 2017 Math Grade 7, Spring 2016 Math Grade 6 - Ranked SIMEX).
Fig. A.35: Goodness of Fit Plot for Spring 2018 Algebra I (Priors Spring 2017 Math Grade 6, Spring 2016 Math 5 - Uncorrected).
Fig. A.36: Goodness of Fit Plot for Spring 2018 Algebra I (Priors Spring 2017 Math Grade 6, Spring 2016 Math 5 - Ranked SIMEX).
Fig. A.37: Goodness of Fit Plot for Spring 2018 Algebra I (Priors Spring 2017 Geometry - Uncorrected).
Fig. A.38: Goodness of Fit Plot for Spring 2018 Algebra I (Priors Spring 2017 Geometry - Ranked SIMEX).
Geometry
Fig. A.39: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Math Grade 8, Spring 2016 Math Grade 7 - Uncorrected).
Fig. A.40: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Math Grade 8, Spring 2016 Math Grade 7 - Ranked SIMEX).
Fig. A.41: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2016 Math Grade 8 - Uncorrected).
Fig. A.42: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2016 Math Grade 8 - Ranked SIMEX).
Fig. A.43: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 6 - Uncorrected).
Fig. A.44: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 6 - Ranked SIMEX).
Fig. A.45: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 7 - Uncorrected).
Fig. A.46: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 7 - Ranked SIMEX).
Fig. A.47: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 8 - Uncorrected).
Fig. A.48: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 8 - Ranked SIMEX).
Fig. A.49: Goodness of Fit Plot for Spring 2018 Geometry (Priors Fall 2017 Algebra I - Uncorrected).
Fig. A.50: Goodness of Fit Plot for Spring 2018 Geometry (Priors Fall 2017 Algebra I - Ranked SIMEX).
Fig. A.51: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2016 Algebra I - Uncorrected).
Fig. A.52: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2016 Algebra I - Ranked SIMEX).
Fig. A.53: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Algebra II, Spring 2016 Algebra I - Uncorrected).
Fig. A.54: Goodness of Fit Plot for Spring 2018 Geometry (Priors Spring 2017 Algebra II, Spring 2016 Algebra I - Ranked SIMEX).
Algebra II
Fig. A.55: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Fall 2017 Geometry - Uncorrected).
Fig. A.56: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Fall 2017 Geometry - Ranked SIMEX).
Fig. A.57: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Geometry, Spring 2016 Algebra I - Uncorrected).
Fig. A.58: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Geometry, Spring 2016 Algebra I - Ranked SIMEX).
Fig. A.59: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Algebra I - Uncorrected).
Fig. A.60: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Algebra I - Ranked SIMEX).
Fig. A.61: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 7 - Uncorrected).
Fig. A.62: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 7 - Ranked SIMEX).
Fig. A.63: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 8 - Uncorrected).
Fig. A.64: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Algebra I, Spring 2016 Math Grade 8 - Ranked SIMEX).
Fig. A.65: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Math Grade 8 - Uncorrected).
Fig. A.66: Goodness of Fit Plot for Spring 2018 Algebra II (Priors Spring 2017 Math Grade 8 - Ranked SIMEX).